i am trying build a face detection with the opencv and openkinect libraries. for the image input i want to use the xbox kinect v2. i am basing my code on the face detection example.

this is my code so far:

import gab.opencv.*;
import java.awt.Rectangle;

/* KINECT */
import org.openkinect.freenect.*;
import org.openkinect.freenect2.*;
import org.openkinect.processing.*;

OpenCV opencv;
Kinect2 kinect2;

Rectangle[] faces;

void setup() {
  opencv = new OpenCV(this, 640/2, 480/2);
  size(640, 480);
  // Kinectv2
  kinect2 = new Kinect2(this);
  kinect2.initVideo();
  kinect2.initDevice();
  
  opencv.loadCascade(OpenCV.CASCADE_FRONTALFACE);  
  faces = opencv.detect();
}

void draw() {
  opencv.loadImage(kinect2.getVideoImage());
  image(kinect2.getVideoImage(), 0, 0, 640, 480);

  noFill();
  stroke(0, 255, 0);
  strokeWeight(3);
  for (int i = 0; i < faces.length; i++) {
    rect(faces[i].x, faces[i].y, faces[i].width, faces[i].height);
  }
}

the problem seems to be in the line "opencv.loadImage(kinect2.getVideoImage());" since the detection does not work. when working with the isight camera (using the build-in function "capture" and "video"-add-on) instead of kinect everything works perfectly fine.

can anyone help?

This was a work from last year, wholly done in Processing. It was the first bigger project for me and has been a really great experience, especially working together with people from other fields such as architecture and communications design.

The interactive installation Bruch (in engl.: crack) makes visitors feel the destruction of millenniums-old artifacts and therefore Syrian cultural history itself. A lone showcase is situated in the middle of the room - its glass destroyed, its content missing - highlighted only by a dim spotlight. Mirroring the shape of the showcase, gauze screens are positioned within some distance around it. Visitors walking towards the real showcase are thereby entering another, virtual scenario made out of gauze on which virtual glass is projected. Upon entering, the glass begins to crack at the position of the visitor. If they come closer to the gauze screen it breaks, revealing images of destroyed artifacts and buildings, illicit excavations and videos of Daesh destroying cultural artifacts.

Three Microsoft Kinect V2s - mounted on top of the gauze screens - track the visitors in real time using a custom made tracking tool which feeds its data to the animation. Here, Voronoi Diagrams are calculated and only shown when the visitor stands in front of the gauze screen giving the impression of glass cracking at his or her position. Box2D, a Physics Engine for Games, is used to let the glass drop slowly to the ground or explode in a sudden burst when the visitor gets too close to the screen.

This interactive installation was presented as part of an archaeological exhibition „Tell Genderes - 20 Meter Menschheitsgeschichte“ about the Syrian settlement mound Tell Genderes (http://tell-genderes.de). The exhibition took place during 12/2015 and 01/2016 in the BildungsTURM Konstanz in Konstanz, Germany and was a result of an ongoing cooperation between the University of Konstanz and the HTWG Konstanz.

I use kinect PV2 version 0.7.5. This library is very great. unfortunately,CoordinateMapperRGBDepth, example broken, check 0.7.2 version. I wish for kinect PV2 to update.

Please tell me anothe way.

windows 8.1 prosessing 3

I'v copy pasted this code now just to see if the connections are ok, but I am getting an error that I am unsure of. I am currently on an MacBook Pro 2011 that doesn't have USB 3, but I can still connect USB 3 devices on it. Could this be related to that?

... Init Kinect2 [Freenect2Impl] enumerating devices... [Freenect2Impl] 7 usb devices connected [Freenect2Impl] found valid Kinect v2 @250:7 with serial 035701545147 [Freenect2Impl] found 1 devices 1 Device Connected! [OpenCLDepthPacketProcessor::listDevice] devices: 0: Intel(R) Core(TM) i7-2820QM CPU @ 2.30GHz (CPU)[Intel] 1: ATI Radeon HD 6750M (GPU)[AMD] [OpenCLDepthPacketProcessor::init] selected device: ATI Radeon HD 6750M (GPU)[AMD] Devce: 0 [Freenect2Impl] enumerating devices... [Freenect2Impl] 7 usb devices connected [Freenect2Impl] found valid Kinect v2 @250:7 with serial 035701545147 [Freenect2Impl] found 1 devices [Freenect2DeviceImpl] opening... [Freenect2DeviceImpl] closing... [Freenect2DeviceImpl] deallocating usb transfer pools... [Freenect2DeviceImpl] closing usb device... [UsbControl::claimInterfaces(IrInterfaceId)] failed! libusb error -3: LIBUSB_ERROR_ACCESS [Freenect2DeviceImpl] closed [Freenect2DeviceImpl] failed to open Kinect v2 @250:7! no device connected or failure opening the default one!

It seems that the Kinect is recognised ok, but I still get: ... [UsbControl::claimInterfaces(IrInterfaceId)] failed! libusb error -3: LIBUSB_ERROR_ACCESS ... no device connected or failure opening the default one!

Just need help narrowing down my search as I don't have any other hardware to test it on. Is it just the USB3 problem?

Thanks, Franck :)

Charles -

    import KinectPV2.*;
    KinectPV2 kinect;
    int f = 20;
    float dist;
    int c;
    boolean detect;
    
    void setup() {   
      size(512, 424);
      frameRate(30);
      kinect = new KinectPV2(this);   
      kinect.enableBodyTrackImg(true);
      kinect.enableDepthImg(false);
      kinect.init();
    }  
    
    void draw() {   
    background(255);    
    image(kinect.getBodyTrackImage(), 0, 0);   
    image(kinect.getDepthImage(), 0, 0);
    int [] rawData = kinect.getRawBodyTrack();
    
    //For 1/8 of my pixels
    for (int i = 0; i < rawData.length; i +=2){
    
      //if pixel is part of the user
      if (rawData[i] != 255){
         float x = (i%width)+1;
         float y = int(i/height);
        
        //draw body with blue lines
        stroke(0,0,255);
        line(x,y,x,y);
    
        //calculate distance between usermapx, usermapy, and rectangle position
        dist = dist(x,f,y,f);
        //if collision found, rectangle is green 
        if (dist < = f) {
         detect=true;
         //else, red
        } else{
          detect=false;
        }
      }
    
    }
    if (detect == false){
      c = color(255,0,0);
    }
    
    if (detect == true){
     c =  color(0,255,0);
    }
    
    pushMatrix();
    fill(c);
    rect(f,f,50,50);
    popMatrix();
    }